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Abstract. In the context of fog computing, we consider a simple case when 
data centers are installed at the edge of the network and assume that if a 
request arrives at an overloaded data center, then it is forwarded to a neigh¬ 
boring data center with some probability. Data centers are assumed to have 
a large number of servers and that traffic at some of them is causing satura¬ 
tion. In this case the other data centers may help to cope with this saturation 
regime by accepting some of the rejected requests. Our aim is to qualitatively 
estimate the gain achieved via cooperation between neighboring data centers. 
After proving some convergence results, related to the scaling limits of loss sys¬ 
tems, for the process describing the number of free servers at both data centers, 
we show that the performance of the system can be expressed in terms of the 
invariant distribution of a random walk in the quarter plane. By using and 
developing existing results in the technical literature, explicit formulas for the 
blocking rates of such a system are derived. 


1. Introduction 

Cloud computing has become one of the major stakes in the development of 
information technology by offering the possibility of reserving computing resources 
online. Commercial offers already exist for customers (residential or business) rely¬ 
ing on big data centers like Amazon or Azure for example. This kind of technology 
is also relevant for network operators in the framework of network function virtu¬ 
alization, where network functions can be instantiated on data centers instead of 
dedicated hardware. In this context, there is currently a clear trend to distribute 
data centers. For network operators, it is possible to instantiate at the edge of 
the network functions which were so far centralized in servers (e.g., mobile core 
functions). Furthermore, by allocating resources closer to end users, it is expected 
to offer better quality of experience. Distributing cloud computing resources at the 
edge of the network is known as fog computing. See and |I2) . 

Data centers involved in fog computing have a smaller capacity than those in the 
case of cloud computing and therefore more subject to congestion. Hence, to reduce 
the probability of request blocking, fog computing data centers have to collaborate. 
For instance, when one request cannot be accommodated by one of them, it may 
be forwarded to another one. 

A typical example of such a situation is when data centers are located on a logical 
ring at the edge of the network. See Figure A request arriving in an overloaded 
data center with index i, may be forwarded to a neighboring data center i—1 or z-l-I 
with some probability. Hence, if the traffic to a data center is causing saturation, 
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the other data centers may help alleviate this saturation regime. The aim of this 
paper is of investigating the impact of such a cooperative scheme. In practice, the 
network could be backed up by a central (bigger) data center at the core of the 
network but at a price in terms of latency. We will not consider this additional 
feature here. 



Collaboration of T-wo Data Centers. Our aim here is to qualitatively estimate 
the gain achieved by the collaboration of data centers at the edge of the network. 

The main part of our analysis will concern the impact of the collaboration of two 
data centers. It is shown in Section[2^that the analysis applies also to more general 
architectures of fog computing, as in Figure provided they are not congested. 

For i S {1,2}, the external arrival process of requests to data center/facility 
referred to as class i requests, is Poisson with parameter A^. If one of the Ci servers 
is idle upon arrival, then the request is processed by this data center. Otherwise, if 
the data center is saturated, i.e., all the Ci servers are busy, then with probability pi 
the request is forwarded to the other data center if it is not saturated too, otherwise 
with probability 1 — Pi the request is rejected. A request allocated at data center 
is processed at rate pi. 

By considering the number of requests processed at both data centers, this 
scheme can be clearly represented by a two dimensional Markov process on {0,..., Ci} x (0,..., C 2 }. 
This Markov process, related to loss networks, is not reversible in general and its 
invariant distribution does not have a product form expression. Even if a numer¬ 
ical analysis of the equilibrium equations is always possible, it is very likely that 
it will not give precise qualitative and quantitative results concerning the impact 
of rerouting parameters pi and p 2 of the offloading scheme. Our goal is of giv¬ 
ing explicit closed form expressions of the equilibrium probability that a request is 
rejected, see Theorem which is our main result in this domain. 

To overcome the difficulty of not having an explicit expression of the equilibrium, 
we have chosen to study a scaled version of this network. The input rates Ai, A 2 
and the capacities Ci, C 2 are assumed to be proportional to a large parameter N 
which goes to infinity. This scaling has been introduced by Kelly in the context of 
loss networks, see m- As it will be seen, there is a relation between the parameters 
(see Condition (E) below), which implies that both data centers can be saturated 
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with positive probability. We will focus mainly on this case which is, in our view, 
the most interesting situation to assess the benefit of offloading mechanisms in a 
congested environment. Otherwise, the situation is much simpler. One of the data 
centers will be underloaded, so that the rejection rate at equilibrium will converge 
to 0 as gets large, in particular external arrivals to this data center and the 
rerouted jobs from the other data center will be accepted with probability 1 in the 
limit. See Propositionand Theorem 

In this limiting regime we prove convergence results for the process describing 
the number of free servers at both data centers in the same way as in m for loss 
networks. We show that the invariant distribution of a random walk in the quarter 
plane is playing a key role in the asymptotic behavior of the loss probabilities at 
equilibrium. The derivation of the equilibrium is based on the analysis of random 
walks in by [7]. By taking advantage of the specific characteristics of the ran¬ 
dom walks considered, we are able to get an explicit expression of the generating 
function of their invariant distributions in terms of elliptic integrals instead of con¬ 
tour integrals in the complex plane as in [7] . See Theorem With these results 
we can then assess quantitatively the interest of this load balancing mechanism by 
comparing the respective loss probabilities of the two streams of requests. 

The organization of this paper is as follows: in Section the stochastic model 
is introduced and the limit results for the scaling regime are obtained. A family of 
random walks is shown to play a central role. Section establishes the functional 
relation satisfied by the generating function of the invariant measure of one of these 
random walks. Section]^ gives an explicit representation of this generating function 
in Theorem]^ and therefore of the performance metrics of the load balancing mech¬ 
anism. Section presents some numerical examples of these results. Concluding 
remarks are presented in Section 


2. Model description 

2 . 1 . Model. We consider in this paper two processing facilities in parallel. The 
first one is equipped with Ci servers and serve requests (for computing resources) 
arriving according to a Poisson process with rate Ai; each request requires an expo¬ 
nentially distributed service time with mean l/fj-i (a request if accepted occupies a 
single server). Similarly, the second processing facility is equipped with C 2 servers 
and serves service requests arriving according to a Poisson process with rate A2; 
service times are exponentially distributed with mean 1/^2- 

To reduce the blocking probability, we assume that requests arriving at a service 
facility with no available servers are forwarded to the other one with a given prob¬ 
ability. More precisely, if a request arrives at service facility ^1 with no available 
servers, the request is forwarded to the other service facility with probability pi. 
Similarly, a request arriving at facility ^2 with no available servers is forwarded to 
the other facility with probability p 2 - See Figure 

Let Li{t) and L 2 {t) denote the number of occupied servers in facilities ^1 and 
^2 at time t, respectively. Owing to the Poisson and exponential service time 
assumptions, {L{t)) = L 2 {t))) is a Markov process with values in the set 

{0,..., Cl} X {0,..., C 2 }, and transitions from {ii,£ 2 ) to (£1 -I- ^,£2 + j) occurring 
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Figure 2 . Load Balancing between Two Data Centers 
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if ihj) 

Pi£i 
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^ 2^2 

if (bj) 


( 1 , 0 ), 

( 0 , 1 ), 

(- 1 , 0 ), 

( 0 ,- 1 ) 


and 0 otherwise. 

The equilibrium characteristics of this Markov process on a finite state space, 
like loss probabilities, do not seem to have closed form expressions in general. A 
scaling approach is used in the following to get some insight on the performance of 
such a strategy. We first introduce a random walk in N^. 


2.2. A random walk in the extended positive quadrant. We now consider 
the following random walk in the extended positive quadrant. 

Definition 1. For fixed I = {li ,^2) one defines the random walk (mfit)) on 

(N U {+00})^ as follows: the transition from {mi, m2) to (mi+a, TO2+6) occurs at 
rate 


( 1 ) 


Pill 

P2I2 

Ai + P2A2l{m2=0} 
A 2 + PlAil{mi=0} 


'if{a,b) = (1,0), 

'if{a,b) = (0,1), 

if (a, b) = (—1, 0) and mi > 0, 

if (a, b) = (0, —1) and m2 > 0, 


for {mi, m2) G (N U {+00})^ with the convention that +00 ± x = +00 for a; G N 
(see Figure^. 


In particular (+00,+00) is an absorbing point for the process {mfit)). The 
random walk imfif)) is a special case of the Markov process investigated in [ 7 ]. 

The following result summarizes the stability properties of this random walk. 
Critical cases are omitted. 


Proposition 1. For I = {li,l2) G 
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Figure 3 . Transitions for 

(i) If one of the conditions 

a) X2 < ^2^2 and Aipi + A2 > fJ-iliPi + H2I2 

b) Al < Pill and Ai + X2P2 > Pih + P2I2P2 

c) Al > pih and X2 > P2I2 

holds then the Markov process {Wii{t)) is ergodic onN^. In this case the unique 
invariant distribution on is denoted by tt; . 

(a) If Xi < Pill and X2 < P2I2, the unique invariant distribution of (Wiift)) on 
the extended state space (N U {+c»})^ is the Dirac measure ( 5 (oo,oo)- 
(Hi) If Xi > pih, X2 < P2I2 and Xipi + A2 < PiPih + P2I2, the unique invariant 
distribution of{fni{t)) on (NU{+oo})^ is Gsi'^Soo, where Gs^ is the geometric 
distribution with parameter 5 i = pili/Xi. 

(iv) If X2 > P2hj Al < Pill and X2P2 + Ai < P2P2h + the unique invariant 
distribution of iWiift)) on (NUj+oo})^ is 6oo®Gs^, where is the geometric 
distribution with parameter 82 = P2l2/X2. 

Proof. Due to [ 7 ], see also m Proposition 9 . 15 ], {mi{f)) is ergodic if and only if 
one of the conditions of (i) holds. As long as it does not hit 0 , the first (resp. 
second) coordinate of (m;(t)) behaves as an M/M /1 queue with arrival rate pih 
(resp. P2I2) and service rate Ai (resp. A2). Under the conditions of (ii), each of 
these M/M /1 queues is transient, in particular starting from 1 , it has a positive 
probability of not returning to 0 . This implies that after some random time, the 
process (rhift)) stays in the interior of the quadrant and therefore behaves as 
a couple of independent transient M/M /1 queues. Consequently, both coordinates 
of {mi{t)) are converging in distribution to +c». Similarly, for (Hi) and (iv), the 
process (mi(t)) can be coupled to two queues, the first one, an M/M /1 queue 
which is transient and the second one, an ergodic M/M /1 queue, with an invariant 
distribution which is geometrically distributed. □ 

2 . 3 . Heavy Traffic Scaling Regime. We investigate now the case when some of 
the parameters of the processing facilities are scaled up by a factor N £ fl. The 
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arrival rates are given by AiA^ and X2N with Ai > 0 and A2 > 0 . Similarly the 
capacities are given by = Nci and = Nc2 for some positive constants Ci 
and C2. To indicate the dependence of the numbers of idle servers upon N, an 
upper index N is added to the stochastic processes. A similar approach has been 
used in [ 3 ] to study a load balancing scheme in an Erlang system. 

We will consider the process 

( 2 ) (m^(t)) = (Cf - Lf - L^{t)) 

describing the number of idle servers in both processing facilities. As it will be 
seen, the random walks {Wii{t)), I G play an important role in the asymptotic 
behavior of (m^(t)) as N goes to infinity. 


Theorem 1. If one of the following conditions 
(E) 


j A2 < IJ.2C2, 

J Ai < pLiCi, 

or < 

[Alpi -1- A2 > fiicipi + PL2C2, 

|Ai - 1- X2P2 > h-ici + M2C2P2, 

1 


Ai > HiCi, 

X2 > H2C2 


holds, and if the initial conditions are such that m^(0 ) = to S and 

'(0) L^{oy 


lim 

A^—>- + oo 


Liy_ 

N 


tN( 

N 


= C= (C 1 ,C 2 ) 


then, for the convergence in distribution, 

for any function f with finite support on , tt^ is the invariant distribution of the 
process irhcft)) defined previously. 


Proof. By using the same method as in |T 0 ] , one gets an analogous result to Theo¬ 
rem 3 of this reference. Eor the convergence in distribution of processes, the relation 

( 3 ) ^ ^ ^ 

7vH.™oo ^ (^h{t),l2{t), J^J^Jix)Tri^u){dx)du'^ 

holds, where {l{t)) = {{li{t), l2{t))) satisfying the following integral equations 


\h{t) = Cl 

]l2(t) = C2 



(Ai) -|-p2A2'Ti(u)(Ali n A2) — piili(u)'j 
(AI2) +PlAl 7 r;(„)(Al 2 n Ai) — fj-2hiu)^ 


dw 

dw. 


for i G { 1 , 2 }, Ai = {to G N^jTOi y 0 } and, for I G K+, tti is the unique invariant 
distribution of lWii{t)). 

Let us assume without loss of generality that, under condition (E), for example 
the first condition of (E) is satisfied. It will be assumed throughout the paper. It 
is not difficult to construct a coupling so (t) > it) holds almost surely for all 
t > 0, where {f)) is the number of jobs of an M/M/C^/C^ queue with arrival 
rate AiA^ and service rate pLi. Since Ai > /iici, a classical result, see Section 7 of 
Chapter 6 of m for example, gives the convergence in distribution 


lim 

N—>-+oo 
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in particular, {h{t)) is a constant equal to ci. 

If, for i e { 1 , 2 }, N'xiN is the Poisson process of arrivals at facility # 7 , by using 
the same coupling as before one gets that the number (t), arrivals at facility ^2 
up to time t, satisfies, for 0 < s < t, U^{t) — (t) — 

nt 

(t) = A/A2A[0,t]+ / 

Jo 

where {Bi{u),u > 0 ) is a family of independent Bernoulli random variables with 
parameter pi. The lower bound includes the direct arrivals A/A 2 Ar[ 0 ,f] to facility 
#2 and the rejected jobs from # 1 . One gets that 

L^it) > Q^it), 

where {Q2 (t)) is a GjMjC^IC2 queue with the arrival process (U^{t)). 

The ergodic theorem gives that, almost surely 

^ t (a 2 + Aipi (^1 - > p2C2t, 

by condition (E). By using this relation, one can show that, for the convergence in 
distribution, the relation 



holds. In particular (hit)) is constant and equal to C2. Therefore, almost surely, 
= (c) holds, hence = tTc- Relation ^ shows that the theorem is proven. 


The following proposition states that the performances of the load balancing 
mechanism can be expressed with the invariant distribution tTc- 

Proposition 2. Under Condition (E), as N goes to infinity, the probability that 
at equilibrium a job of class i G { 1 , 2 } is rejected converges to 

Pi = TTc (m e N^, mi = 0) (1 - Pi) + piTTc ( 0 , 0 ), 

where tTc is the invariant distribution of{fnc(t)). 

Proof. Assume that (L^(t),L^(t)) is at equilibrium, the number of class 1 jobs 
rejected between 0 and t is given by 

-^1 (^) / )—0,Ri(u —)—0}*A^iA'(dri)T / )—0,m^(u —)—Al(du). 

Jo Jo 

The probability of rejecting a class 1 job is hence given by 

P(mf( 0 ) = 0 ,Ri( 0 ) = 0 ) +P(mf( 0 ) = 0 ,TOf ( 0 ) = 0 ,Ri( 0 ) = 1 ) = 

By using the martingales associated with Poisson processes, one gets 
E«(l)) 


AiIV 


(l-pi)E^^ du^+PiE l{^iv 

one concludes with the convergence of the previous theorem. 


XiN 


{u—)—0,m^{u—)=0} 


du 


□ 
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When condition (E) is not satisfied, one can obtain an analogous result. Its 
(elementary) proof is skipped. The results on the asymptotic blocking probability 
of jobs are summarized in the following proposition, where (A), (Bi) and {B 2 ) are 
exclusive. 


Proposition 3. Let 

[A2<M2C2 [Ai+A2P2</^lCl+Ai2C2P2 [ A 2 +A 1 P 1 <C2/r2+MlClPl 

then, at equilibrium, the loss probability of a job of class i S {1, 2} js converging to 
Pi as N goes to infinity, where 

r-TTc (m e N^, TOi=0) (1-Pi)+Pi7rc(0, 0) if (E) holds, 

(4) /3j = i 0 if (A) or {Bp holds, 

[ (1 - Pi) (1 - MiCi/Aj) if {B 3 _i) holds. 

2.4. An Extension to Multiple Data Centers. In this section, it is assumed 
that there are J data centers, for \ < j < J, the jth data center has CjN servers 
and the external arrivals to it are Poisson with parameter XjN and services are 
exponentially distributed with parameter fij. If an external request at data center 
j finds all CjN servers occupied, it is re-routed to data center j+1 (with J-l-1 = 1) 
or to data center j—1 (with 0=J) with probability pj, otherwise it is rejected. In 
particular a job is rerouted with probability 2pj in the case of congestion. See 
Figure 

For 1 < j < T, one defines the random walk {wPpt)) on as follows: the 
transition from (m, n) G to (m-|-a, n+b) occurs at rate 


qijCj 

if (a, b) 

Lj+iCj+i 

if (a, b) 

Aj +Pj+iAj+il{„=o} 

if (a, b) 

Aj+i “t“ PjAjlj^—0} 

if (a, b) 


( 1 , 0 ), 

( 0 , 1 ), 

(—1, 0) and m > 0, 
(0,-1) and n > 0. 


If one of the conditions 


f Aj > HjCj, 

1 Aj+i > Pj-i-iCj+i, 


A J -|_ 1 ^ 

A J “b A J -|_ 1 pj +1 ^ fJ.j Cj Pj 


Aj < PjCj, 

Aj-j-i-b \jPj^fJ,jj.±Cjj-i-\~Pjj^jC 


holds, one gets that the associated Markov process is ergodic by Proposition 
one denotes by tt^ its invariant probability distribution. As before, one takes the 
following convention for the indices, J-|-l=l and 1—1=J. 

We now give a version of the previous proposition in this context. 


Proposition 4. At equilibrium, the loss probability of a job of class j G {1,..., J} 
is converging to Pj as N goes to infinity in the following cases, 

(1) No Congestion. 

If Aj < pLjCj for all j G {1,..., J} then Pj = 0. 

(2) One saturated node. 

If, for some jo G J}, \jg>p,j^Cj^ and if Aj < p,jCj holds for all 
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j ^ jo and 


I '^io + l + ^joPjo ^ Mio+l'^io+l + PjoPjo^jo 
['^io-1 + ^joPjo ^ Pjo-i^jo-i + PjoPjo^jo^ 

then 13j = 0 if j ^ jo and 13 = (1 - 2pj J(l - MjoCjo/-^jo) 

(3) Two saturated neighboring nodes. 

If, for some jo G {1, ..., J}, one of the conditions (Ej^) holds and Xj < fijcj 
holds for all j jo,jo+3 and 

i Ajo+2 + Ajo + lPjo + l'^c“(Nx{0}) < ^jg+2Cjo+2 


then 


I Pjo = TT? ({0}xN) (l-2pjJ+pjo7r^o(0, 0) 

\Pjo+i = TT? (Nx{0}) (l-2pjo+i)+pjo+i7r^o(0,0). 

The proof is similar to the proof of the previous proposition and is therefore 
omitted. Note that Condition ([^ implies that the nodes with index jo — 1 and 
jo + 2 are underloaded, so that only nodes with index jo and jo + 1 are congested. 
This result covers partially the set of various possibilities but, as long as only two 
neighboring nodes are congested, it can be extended quite easily to the case where 
only pairs of nodes are congested. 

When there are at least three neighboring congested nodes, this method does not 
apply. It occurs when one of the conditions {Ejg) holds and one of the conditions 
of © is not satisfied. One has to consider the invariant distributions of a three 
dimensional random walk in for which there are scarce results. Nevertheless 
this situation should be, in practice, unlikely if the fog computing architecture 
is conveniently designed so that a local congestion can be solved by using the 
neighboring resources. 

This proposition shows that the evaluation of the performances of the offloading 
algorithm can be expressed in terms of the invariant distributions of the random 
walks {fficit)) introduced in Definition]^ The rest of the paper is devoted to the 
analysis of these invariant distributions when they exist. In particular, we will 
derive an explicit expression of the blocking probabilities Pi at facility jf i. 


3. Characteristics of the limiting random walk 

3.1. Fundamental equations. Throughout this section, we assume that the first 
condition of (E) holds. Let mj, i and TOc ,2 denote the abscissa and the ordinate of 
the random walk {jficit)) in the stationary regime. Under stability condition (E), 
it is shown in [7] that the generating function of the stationary numbers TOc,i and 
me, 2 , defined by P{x, y) = fQ,. complex x and y such that |a:| < 1 and 

|i/| < 1, satisfies the functional equation 


(6) hi{x,y)P{x,y) = h2{x,y)P{x,0) + ho{x,y)P{t),y) + /i 4 (x, y)7rc(0,0), 
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with 7rc(0, 0) standing for P(0,0) and 

hi{x,y) = -yicix'^y - y2C2xy‘^ + (Ai + A2 + HiCi + fJ.2C2)xy - Xiy - X2X, 

h2ix,y) = X2 {{l-p2)xy - x + p2y), 

h^{x,y) = Ai {(l-pi)xy - y + pix ), 

h 4 ix, y) = {Xipi + X2P2)xy - P2A2?/ - piXix. 


It is worth noting that 

(7) Aipi(Ai + A2P2)h2(a;,i/) + A2P2(A2 + Aipi)/i3{a;,2/)-AiA2(l-_piP2)h4{a;,2/) = 0. 

In [HIS], it is shown how to compute the unknown functions by using the zeros of 
the kernel hi(x,y) and the results on Riemann-Hilbert problems. In the following 
we briefly describe how to achieve this goal. For the system under consideration, 
let us recall that the performance of the system is characterized by the blocking 
probabilities of the two classes of customers. For customers arriving at facility #1, 
the blocking probability is given by 

(8) /?! =P(0,l)(I-pi)+pi7r,(0,0) 
and that for customers arriving at the second facility by 

(9) /32 =P(1,0)(I-P2)+P27re(0,0). 

By using the normalizing condition P(I,1) = 1, we can easily show that 
Ai + A2P2P(1, 0) - pici = AiP(0,1) + A2P27rc(0,0) 


and 

A 2 + AipiP(0,1) — /X 2 C 2 = A2P(I, 0) + Aipi7rc(0,0). 

We then deduce that 


( 10 ) 


P(0,1) 


Al — PlCi + P2{X2 — /i2C2) — P2{X2 + AiPi)7re(0, 0) 

(1 -piP 2 )Xl 


and 


( 11 ) 


P(1,0) = 


A 2 - M 2 C 2 +Pi(Ai - pici) -pi{Xi + A2P2)7rc(0,0) 


(1-P1P2)A2 

The above relations show that the blocking probabilities /3i and (32 can be estimated 
as soon as the quantity 7rc(0, 0) is known. 


3.2. Zero pairs of the kernel. The kernel hi{x,y) has already been studied in 
[7] in the framework of coupled servers. For fixed y, the kernel hi(x,y) has two 
roots Xo{y) and Xi{y). By using the usual definition of the square root such that 
^/a > 0 for a > 0, the solution which is null at the origin and denoted by Xg^y), is 
defined and analytic in C \ ([y 1 , 1 / 2 ] U [ 2 / 3 , 2 / 4 ]) where the reals yi,y 2 , 1/3 and j /4 are 
such that 0 < 2/1 < 2/2 < 1 < 2/3 < 2 / 4 - The other solution Xi{y) is meromorphic in 
C \ ([ 221 , 2 / 2 ] U [ 223 , 2 / 4 ]) with a pole at 0. The function Xo{y) is precisely defined by 

-(M 2 C 22 /^ - (Al + A 2 + pici + p 2 C 2 )y + X 2 ) + 0 - 1 ( 2 /) 


Xoiy) = 


2 piciy 


with 


^liy) — (/42C22/^ ~ (Al + A 2 + PiCi + 2 * 202 ) 2 / + A2)^ — 42*iCiAi2/^, 
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where ui {y) is the analytic continuation in C \ ([yi, 1/2] U [y^, 1/4]) of the func¬ 
tion Ai{y) defined in the neighborhood of 0 . The other solution Xi(y) = 

Xi/{yiCiXo{y)). 

When y crosses the segment [yi,y2], Xo{y) and Xi{y) describe the circle Cr^ 
with center 0 and radius ri = ^ Ai/(/i,iCi) > 1, since from the first of condition 
of (E), we have Ai > yici. 

Similarly, for fixed x, the kernel K{x,y) has two roots bb(x) and Yi{x). The 
root Yq{x), which is null at the origin, is analytic in C \ ([a;i,a;2] U [2:3,0:4]) where 
the reals xi, X2, X3 and x^ are such that with 0 < xi < 2:2 < 1 < ^3 < 2:4 and is 
given by 


Yo{x) 


— {fxicix'^ — (Ai -I- A 2 -I- /iici -I- y2C2)x + Ai) -I- 0 - 2 ( 2 ;) 

2 fJ,2C2X 


with 


^ 2 ( 2 ;) = {fiicix'^ — (Ai -I- A 2 -I- yici + y2C2)x + Ai)^ — 4^2C2A2a;^, 

where 0-2(2;) is the analytic continuation in C \ ([2;i,2;2] U [2;3,2;4]) of the function 
^/A^Oe) defined in the neighborhood of 0 . The other root Yi{x) = A2/(/r2C2bb(2:)) 
and is meromorphic in C \ ([xi, X2] U [X3, X4]) with a pole at the origin. 

When X crosses the segment [xi, X2], To(y) and Yi{y) describe the circle with 
center 0 and radius r2 = \/\2/{y2C2)- 


4. Boundary value problems 


4 . 1 . Problem formulation. In [8], it is proven that the functions P(x, 0 ) and 
P{ 0 ,y) can be extended as meromorphic functions in C \ [x3,X4] and C \ [1/3,1/4], 
respectively. By using the fact that Wo(y) and Xi{y) are on circle for y G 
[j/172/2], we easily deduce that the function P(x, 0 ), analytic in (the disk with 
center 0 and radius ri), is such that for x € 


( 12 ) 


h2{x,Yo{x)) ^4(2;, To (x)) 


where yo(2;) G [^1,^2]- 

Similarly, the function P( 0 , y) is analytic in which is the disk with center 0 
and radius r2 , and for x G , we have 


( 13 ) 


5 ft 


■ h 3 {Xo{y),y) 


h2iXoiy),y) 

By using Equation Q, we have 
h4{x,y) 
h2{x,y) 


P{0,y)] =5 


/ h 4 {Xo{y),y) 
\h2{Xo{y),y)‘ 


=( 0 , 0 ) 


P2{X2 -k ( M{x,y) 


Ai(l -P1P2) 


h2{x,y) 


Equation ( 13 ) can then be rewritten as 
■ h 3 {Xo{y),y) 


( 14 ) 


5ft 


h2{Xoiy),y) 


Pi0,y) 


P 2 {X 2 + AiPi) 
Ai(l -P1P2) 


Similarly, Equation (| 12 [) can be rewritten as 


( 15 ) 


5ft 


fe2(x, Eo(x)) 

/i 3 (x,ro( 2 ;)) 


P(x,0) -k 


Pi(Ai -k A2P2) 
A2(1 -P1P2) 


7 rc( 0 , 0 ) 


7 rc( 0 , 0 ) 


= 0 . 


= 0 . 
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Problem ( |l5| corresponds to Problem (7.6) in [7] for which ii = 12 = is = 0 in 
the notation of that paper. The ratio h 2 {x,YQ{x))/hs{x,YQ{x)) corresponds to the 
function J{x) in [7]. 

In the following, we focus on Riemann-Hilbert problem (14). The analysis of 
problem (15) is completely symmetrical. Moreover, to compute the blocking prob¬ 
abilities /?! and (32, we only need to compute the quantity 7rc(0, 0). 


4.2. Problem resolution. The function P{0,y) is analytic in the open disk 1)^2 ■ 
By using the reflection principle [5], the function 


y ^ P{0,rl/y) 


is analytic on the outside of the closed disk Dr 2 - It is then easily checked that if 
we define 


(16) 


P{o,y) 


Friy) = < 


P2(A2 -I- Aipi) 
Ai(l -P 1 P 2 ) 


7rc(0,0), 


P{0,rl/y) 


P2{^2 + AlPl) 
Ai(l -P 1 P 2 ) 


7rc(0,0), 


y €: Dr 2 1 

y €C\Dr 2 , 


the function Fy (y) is sectionally analytic with respect to the circle (7^2, the quantity 
FY{y) tends to 7rc(0,0)(Ai -I- A 2 P 2 )/(Ai(l — P 1 P 2 )) when y goes to infinity, and for 
y € Cr 2 


(17) 


F^{y) = aY{y)F§{y), 


where Fyijj) (resp. Fyiy)) is the interior (resp. exterior) limit of the function 
Fyiy) at the circle 0 ^- 2 , and the function ayiy) is defined on (7^2 by 


(18) 


ayiy) 


ariy) 

ayiy) 


with 


ayiy) = 


h'i{Xo{y),y) 


h2iXo{y),y)' 

The solutions to Riemann-Hilbert problems of form 0 are given in [5]. We 
first have to determine the index of the problem defined as 


Ky = — varygCr2 a.Tgay{y). 


In [3 Theorem 7.2] it is shown that the stability condition (E) is equivalent to 
Ky — 0. 

To obtain explicit expressions, let us first study the function ay{y), which can 
be expressed as follows. 


Lemma 4.1. The function ay{y) defined for y S Cr 2 by Equation (18) can be 
extended as a meromorphic function in C\ ([j/i, 2 / 2 ] U [ 2 / 3 , j/ 4 ]) by setting 


(19) 


( ) = A2(1 -piP2)7Co(y) -b2/Ry(Xo(2/)) 

^ y{P 2 C 2 (l - piP 2 )yXo{y) + Ry{Xo{y))) ’ 


where 

( 20 ) 

Ry{x) = pipiCi(l-p 2 )a;^ + (piP 2 (piCi-l-/r 2 C 2 )-(l-p 2 )(A 2 -l-Aipi))a:-p 2 (A 2 -l-Aipi). 
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Proof. We have for (x, y) such that y G and x = Xo{y) 
h-i{x,y)h 2 {x,y) = A 1 A 2 (((1 -_pi)a; - 1){{1 - p 2 )x + p 2 )yy 

-((1 - pi)x - l)xy + pix{{l - p 2 )x + p 2 )y - Pix"^) 
By using the fact that yy = A 2 / {^ 2 ^ 2 ) and hi{x, y) = 0, we deduce that 

h3ix,y)h2{x,y) = —11 (A2(l -^ 1 ^ 2 ) 2 ; + 2/i?F(a;)), 

^J-2C2y 

where Ry{x) is defined by Equation ( [^ , and the result follows. □ 

Since the index of the Riemann-Hilbert 0 is null, the solution is as follows. 

Lemma 4.2. The solution to the Riemann-Hilbert problem 0 exists and is unique 
and given for y G Dr^ by 

A-(ri = a1i 

- Ai)0y(ai) 



TY{y) = exp 


xhi(x,y) 


{1 - PlP2)^y-A2{x) 


dx 


^ (1 - piP2){piCix'^ - (Ai + A 2 + AiiCi + P2C2)X + Ai) - 2Ry{x) j ' 
Proof. Since the index of the Riemann-Hilbert ^ is null, the solution reads [6] 


Friy) = </'y(y)exp 


2iTT 


log aY{z) 
z-y 


dz 


where the function aY{y) is defined by Equation (19) and 4>Y{y) is a polynomial. 
Since we know that FY{y) —> 7rc(0,0)(Ai -I-A 2 P 2 )/(Ai(l — P 1 P 2 )) as |y| —)■ 00 , then 

= AM 

Let for y G and y = Fo(a; + *0) for x G [xi, ^ 2 ] 

Qy{x) = arg (-Ai 2 C 2 (l - PiP 2 )yo{x -f 0i)x - Ry{x)) 


By using the expression of Yo{x), Equation (23) follows. It is clear that 

logav(lb(a^ + 01)) = —2i0y(a;). 


Since Yq{x Oi) =Yq{x — Oi), we have 


2 iTr 


log ay (z) 1 

- dz = — 


^-y 


TT , 
1 
TT 


xi 

rX 2 


logay(Ao(2^ -f Oi)) dEp 
Yq{x PQi) — y dec 
-2i dEo 


{x + Oi) ) dx 


(x -I- Oi) I 0y (x) dx. 


^Eo(2; + Oi) — y dx 
It is easily checked from the equation hi (x, lb (a;)) = 0 that 

dYp _ -2^iCixYo(x) - P2C2Yo{x)‘^ + (Ai -I- A 2 -I- A^iCi -|- p2C2)Yo{x) - X 2 
dx /iiCiX^ -I- 2p2C2XYo{x) — (Ai -I- A 2 -I- PlCi + P2C2)x + Ai 
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For X G [xi,X2], we have 

+ 2h2C2xYo{x + Oi) — (Ai + A 2 + /llCl + l^2C2)x + Ai = —i\/—l^2{x) 


By using once again hi(x, Yq(x + Oi)) = 0, we obtain for x G [xi,X 2 ] 


^^ 0 ^ , r,A_ {>'1 - y^iCix'^)Yo{x + Oi) 


and then for real y 


- 2 i 


dFn 


Yq(x + 0 i) — y da; 


{x + Oi) 


(/iicia:^ - Xi)y 
xhi{x,y) 


It follows that for real y 

1 f log ariz) jyicix'^ - Xi)Qy{x) 

^~y xhi{x,y) 

It is easily checked that the function on the right hand side of the above equation 
can analytically be continued in the disk 11^2 and the result follows. □ 


In view of the above lemma, we can state the main result of this section. 


Theorem 2. The function P(0,y) can be defined as a meromorphic function in 
C\[y 3 , 2 / 4 ] by setting 
( 24 ) 


Ai + A2P2 . P2(A2 + AiPi) 

TTfi0,0)ipY{y) - -T-r. -G7rc(0,0), y G 


Pio.y)= 


Ai(l -P1P2) 

X 1 +X 2 P 2 


Ai(l -P1P2) 


. Ai(l-piP2) 


TTc ( 0 , 0 )Q;y {y)ipY iy) - 7 re( 0 , 0 ) , y eC\Dr^, 


where ipY^y) is defined by Equation (22). 


Proof. Since the solution to the Riemann-Hilbert problem (141 is unique, the func¬ 
tion P{0,y) coincides with the function 

p / s I P2{X2 + Xipi) 

A. (1 


in 0 ^2- We can extend this function as follows. Noting that the function log ay (y) 
is analytic in a neighborhood of the circle Cr 2 , the function 


y exp 



log«y(^) 

z-y 



defined for y G 0^2 can be continued as a meromorphic function in C \ [x^^xfi by 
considering the function dehned for y G C \ 0^-2, by 


aY{y) exp 



log ay(z) 
z-y 



ay (y) exp 


y jpicix'^ - Ai)ey(3;) 
71-A 1 xhi{x,y) 


da; 


where the last equality is obtained by using the same arguments as above (consider 
first real y and then extend the function by analytic continuation). □ 
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For the system under consideration, let us recall that the performance of the 
system is characterized by the blocking probabilities of the two classes of customers. 
The following theorem summarizes the main results of the paper for Condition (E). 
Proposition covers the other cases. 


Theorem 3. Under Condition (E), as N goes to infinity, the probability that at 
equilibrium a job of facility ffi, i € {1,2} is rejected converges to j3i with 

(Ai-^lCi+P2(A2-Al2C2)-p2(A2+AiPi)7rc(0,0))(l-pi) 


/3i = 


132 = 


Xl{l-piP 2 ) 

(A2-Al2C2+Pl(Ai-^lCi)-pi(Ai+A2P2)7rc(0,0))(l-p2) 


A2(1-P1P2) 
and the quantity 7rc(0,0) is given by 

' Ai + X2P2 - {pici + P2C2P2) 

(Ai + X2P2)py{3) 

X2 + AiPi - ^iCiPi - /i2C2 
Pi(Ai + X2P2)py{3) 
where PY(y) is defined by Equation 


+Pi7rc(0, 0) 
+P27rc(0, 0) 


(25) 


71^(0, 0) = < 


if X2 > P2C2, 


if X2 < P2C2, 


Proof. In the case A 2 > P 2 C 2 , the result easily follows by using Equation (24) for 
y = I and Equation (10). 

In the case X 2 < P 2 C 2 (and then Ai > piCi by Condition (E)), we have Aro(l) = I 
and then, by Relation (19), one gets the expression for av(l), 

Ai + X2P2 - PiCi - P2C2P2 

ay(l =PiT—rw-■ 

A 2 + Aipi - picipi - 112 C 2 

Equation ( [2^ then easily follows. The formulas for the blocking probabilities are 
obtained by using Relations ^ and for fii and P 2 and the expressions ( [l0| ) 
and (II) for P(0,1) and P(1,0). □ 


To conclude this section, it is worth noting that the computation of the function 
<PY{y) in the quantity 71^(0, 0) involves elliptic integrals. In addition, a similar 
result holds for the function P{x,0). This enables us to completely compute the 
generating function P{x,y). 


5. Numerical results: Offloading small data centers 

In this section, we illustrate the results obtained in the previous sections (in 
particular Theorem in order to estimate the gain achieved by the offloading 
scheme. We assume that the service rate at both facilities is the same and taken 
equal to unity {pi = p 2 = !)• Assume in addition that the first data center has a 
capacity much smaller than the second one, e.g., ci = 1 and C 2 = 10. 

We consider the case when all the requests blocked at the first data center are 
forwarded to the second one (pi = I) and none blocked at the second data center 
is forwarded to the first one {p 2 = 0). 

In Figures 1^ and when the arrival rate Ai at the first data center increases, 
the loss rate j3\ goes from 0 if (A) or (Pi) holds to a positive value if (P 2 ) or 
[E) holds. For example in Figure for pi = I, we can see the transition from 
(P 2 ) to {E) when Ai = 3, and for pi = 0.7, the transition from (P 2 ) to {E) when 
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Ai = 1 + 2/0.7 ~ 3.85. We can checked that /3i is a continuous and not differentiable 
function of Ai at 1 + 2/0.7. If pi = 0.35 or pi = 0, {E) holds for the range of values 
[1,5] considered here for Ai. In Figure]^ A 2 = 12 thus {E) holds for Ai S [1,5], as 
Ai > pici and A 2 > pL 2 C 2 - 

In conclusion. Figures]^ and [^ show that the offloading mechanism improves a lot 
the loss rate /3i of the requests of class 1 and does not significantly deteriorate the 
corresponding performances at facility #2 in the case of systematic rerouting {pi = 
1), even when this data center is already significantly loaded as in Figure [5](B). 
This means that offloading small date centers with a big back-up data center is a 
good strategy to reduce blocking in fog computing. 




1 2 3 4 5 


1 2 3 4 5 

-^1 


(a) Loss probability of class 1 


(b) Loss probability of class 2 


Figure 4 . Loss probabilities as a function of Ai with A2=8, ci=l, 
C2=10, fti=l, /r 2 =l, P2=0. The crosses represent simulation points 
while solid curves are plotted from analytical results. 




(a) Loss probability of class 1 (b) Loss probability of class 2 

Figure 5 . Loss probabilities as a function of Ai with A2=12, ci=l, 
C2=10, /r 2 =l, 7*2=0. The crosses represent simulation points 

while solid curves are plotted from analytical results. 
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(a) Loss probability of class 1 (b) Loss probability of class 2 

Figure 6. Loss probabilities as a function ofpi with ci=l, C2=10, 

Ai=1.2, ni=l, /i2=l, P2=0- 


Figures illustrate the impact of the choice of pi when facility ^2 is almost 
overloaded, A 2 = 9.9 so that A 2 < C 2 P 2 , and with a high load A 2 = 11.1. As it 
can be seen, even when pi = 1, the performances of class 2 requests are not really 
impacted by the offloading scheme, whereas the loss rate of class 1 is significantly 
changed. This confirms the benefit of the offloading strategy. 

6. Conclusion 

We have proposed in this paper an analytical model to study a simple offloading 
strategy for data centers in the framework of fog computing under heavy loads. 
The strategy considered consists of forwarding with a certain probability requests 
blocked at a small data center to a big back-up data center. The model considered 
could also be used to study the offload of requests blocked at the big data center 
onto a small data center but this case has not been considered in the numerical ap¬ 
plications. The key finding is that the proposed strategy can significantly improves 
blocking at a small data center without affecting too much blocking at the big data 
center. 
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